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Abstract — On a fading channel with no channel state informa- 
tion at the receiver, calculating true log-likelihood ratios (LLR) is 
complicated. Existing work assume that the power of the additive 
noise is known and use the expected value of the fading gain in a 
linear function of the channel output to find approximate LLRs. 
In this work, we first assume that the power of the additive noise 
is known and we find the optimum linear approximation of LLRs 
in the sense of maximum achievable transmission rate on the 
channel. The maximum achievable rate under this linear LLR 
calculation is almost equal to the maximum achievable rate under 
true LLR calculation. We also observe that this method appears 
to be the optimum in the sense of bit error rate performance too. 
These results are then extended to the case that the noise power 
is unknown at the receiver and a performance almost identical 
to the case that the noise power is perfectly known is obtained. 

I. Introduction 

Iterative decoding has received much attention in the past 
decade due to its exemplary performance. There have been 
many advances in iterative decoding techniques and it has been 
shown that using graphical codes such as low-density parity- 
check (LDPC) codes [1] and turbo codes [2] associated with 
iterative decoding, the Shannon limit on many channels (e.g., 
additive white Gaussian noise channel) can be approached [3]. 
Therefore, these codes have also been proposed for wireless 
fading channels [4]. 

Application of LDPC codes on Rayleigh fading channel 
is pioneered in [4], where a detailed study of performance 
and code design is conducted. This work is later extended 
to complex fading channels [5], to Rician fading channels [6], 
and also to Rayleigh block fading channels [7]. The application 
of turbo codes on Rayleigh fading channels is also studied in 
[8]. 

For soft iterative decoding, log-likelihood ratios (LLRs) 
at the output of the channel are calculated. The process 
of computing LLRs depends on whether or not a perfect 
knowledge of the channel parameters exists at the receiver. 
The capacity of the fading channel is also affected with the 
availability of channel parameters at the receiver [8]. 

An uncorrelated fading channel can be modeled with a 
fading gain r and an additive Gaussian noise n ~ JV{Q,a'^). 
When r is known at the receiver as a perfect side information 
(SI), LLRs are linear functions of the channel output [4]. Exact 
LLR computation depends on a perfect knowledge of cr„ at 
the receiver. 



In order to have SI at the receiver, channel estimation 
techniques must be used. These techniques increase the com- 
plexity of the system, can cause a significant overhead, and 
are themselves subject to imperfections. For high throughput 
wireless applications, the receiver may not be able to handle 
the extra complexity or overhead. This paper provides an 
alternative solution which does not require channel estimation, 
yet provides better performance compared to the existing 
solutions that use fixed fading gain estimates in the decoder 

With no SI available at the receiver, LLRs are complicated 
functions of the channel output [9] and depend on the probabil- 
ity density function (pdf) of r. An approximate LLR, however, 
can be computed as a linear function of the channel output 
[9]. The coefficient of this linear function depends on a fixed 
estimate f of the channel fading gain and a knowledge of (t„. 
Previous work assume that an is known and use the expected 
value of r for f [4], [8]. While the expected value of the 
fading gain is the minimum mean square error estimation of 
r, it is not guaranteed that this choice provides the optimum 
performance in the decoder. 

In a general setup (which includes famous fading channel 
models such as uncorrelated Rayleigh and Rician fading 
channels), we propose the following question: Assume that the 
pdf of r is known at the receiver, but the channel fading gain 
is not. Also assume that LLRs are to be computed as linear 
functions of the channel output. What linear approximation 
provides the optimum decoding performance? 

This question is studied in this paper and the following 
contributions are made: (1) When (7„ is known, we find a linear 
LLR approximation which allows for the maximum achievable 
code rate on the channel. We prove that the optimum linear 
approximation is unique and we observe that, on a Rayleigh 
fading channel, it closely approaches the capacity under true 
LLR calculation. This solution can significantly outperform 
LLR calculation based on the expected value of r. We also 
design irregular LDPC codes which approach this maximum 
achievable rate. (2) When neither r nor cr„ is known at the 
receiver, we propose a linear LLR calculation technique which 
guarantees the convergence of the decoder over the widest 
possible range of (T„. The performance of this solution is 
almost identical to the case that ct„ is perfectly known. We 
design appropriate irregular LDPC codes for this case too. 

This paper is organized as follows. Section HI] reviews some 
preliminaries and studies the proposed approaches. Section Hill 



studies the problem when dn is known to the receiver. Section 
|IV] extends our resuhs to the case that (t„ is unknown. Section 
|V] concludes the paper 

II. Preliminaries and Approaches 

A. System model 

Consider the following channel model. The output of the 
channel is given by 



y = r ■ X + n, 



(1) 



where x e {—1,1} represents the input signal and n is the 
Gaussian noise with zero mean and variance cr^j. Also r > is 
the channel gain which has an arbitrary pdf p{r) and changes 
independently from one channel use to another. Uncorrelated 
fading channels fall into this system model where r represents 
the channel fading gain. 

B. LLR definition and distributions 

For soft decoding, LLRs are usually computed and used. 
Analysis of some iterative decoders is based on the pdf of 
LLRs under the assumption that the all-zero codeword {x = 
+1) is transmitted [10]. 

For the model in ([T]l, the conditional pdf of y is given by 
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which represents a Gaussian distribution with mean x • r and 
variance cr^. We are interested to compute the channel LLRs 
and their pdf. 

1 ) Ideal SI: When we have ideal SI, the channel fading gain 
r is known for each received bit. Also, the receiver knows the 
noise power. Therefore, the LLR is given by [4] 



I = log 



Pjx ^ +l\y,r) 



P(x 



—y ■ r, 



(3) 



which is a linear function of y. 

2) No SI: When no side information is available at the 
receiver, the channel LLR is 



I = log 



P{x^+l\y) 
P{x = -l\yy 



(4) 



which can be a complicated function of y in general. For 
instance, on a normalized Rayleigh channel (i.e., p{r) = 
2re^'' ) we have 



I = log 



, $(y/V2a,2(l + 2a2)) 
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(5) 



where $(2:) = 1 + ^/nze^ erfc(— z) and erfc(-) represents the 
complementary error function [9]. This LLR is a complicated 
function of y and hard to be calculated in the decoder. Also, 
calculating the LLR pdf is difficult. To simplify the LLR 
calculation, motivated by (O, we write I as 



—y -r = ay, 



(6) 



where ar^ represents the receiver's estimate of the Gaussian 
noise variance cr^ and f represents a fixed receiver's estimate 
of the fading gain r. Here, a — 2j^. This linear representation 
of LLR is consistent with the results in [9] which states that 
the LLR can be approximated by a linear function of y. This 
approach is also consistent with existing work which assumes 
that (T„ is known and uses expected value of r (E[r]) as f [4]. 
The conditional pdf of I is 
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To get the unconditional pdf ofl,^ should be averaged over 
the density of r. For example, for the normalized Rayleigh 
fading channel we have 
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where A = 



2^-2\i ■ This pdf is parameterized by cr„ and a. 

If (T„ = (T„ and f = E[r], i.e., a — 2^^, (O reduces to the 
distribution in [4, Eq. 16]. 

C. Capacity 

The capacity of a binary-input memoryless symmetric chan- 
nel (BMSC) can be given via the pdf p{l) of the LLR by [1 1] 

/oo 
log2 (1 + e-')p{l)dl. 

(9) 

The above relation is only valid for BMSCs where the LLR pdf 
is consistent (i.e., p{—l) = e^^pil)). The channel capacity C 
can be computed in two cases: with ideal SI or no SI. In each 
case, their corresponding LLR distribution should be used in 
(|9]l. In the absence of SI at the receiver, the quantity calculated 
by putting p{l) in (|9]l called C is not the channel capacity 
since / is a linear approximation and not the true LLR. Also, 
since p{l) is not consistent, C does not represent the highest 
achievable transmission rate under linear LLR calculation of 
(|6]l. However, we observe that by maximizing C with respect 
to a, p(l) nearly becomes a consistent distribution and C 
predicts the maximum transmission rate under this optimum 
linear LLR calculation quite accurately. This maximum C is 
extremely close to C in the absence of SI (see Fig. |2]l. 

D. LDPC codes decoding and analysis 

Some of the results of this paper are shown through analysis 
and design of LDPC codes. Therefore, a quick review of LDPC 
codes seems relevant. We use {\{x) , p{x)) to denote an 
ensemble of LDPC codes of length N with variable and check 
node degree distributions \{x) and p{x) respectively [10]. 

Many different message-passing algorithms can be used for 
the decoding of LDPC codes. In this work, our focus will be 
on the sum-product algorithm [12]. 



For the channel model of ([T]i, the decoding threshold cr* of 
an ensemble of LDPC codes is defined as the maximum noise 
standard deviation a„ for which the bit error probability of the 
message-passing decoder gets arbitrarily small when the code 
length is growing [10], [13] if and only if (t„ < fi*. This cr* 
depends on whether SI is available at the receiver or not. 

The most exact LDPC code analysis is density evolution, 
which takes the pdf of the channel LLRs and tracks the 
evolution of the pdf of the decoder's extrinsic messages in 
each iteration [10], [13]. Formulation of this method in closed 
form is too complex, hence, some numerical approximations 
are often used [3]. 

E. Code design 

It is well known that carefully designed irregular LDPC 
codes can approach the capacity of many channel models 
(e.g., see [3]). Two code design processes associated with two 
measures of performance can be defined one as maximizing 
the threshold of the code over its degree distributions given a 
target code rate and another one, as maximizing the code rate 
over its degree distributions given the channel LLR pdf. 

III. Optimum linear LLR calculation 

As mentioned before, when no SI is available at the re- 
ceiver, one can calculate the LLRs linearly via ^ as an 
approximation to (|4|i. The objective is to find the optimal 
Unear approximation. Different measures of optimality can 
be considered. Existing work assumes that tT„ is known and 
chooses f = E[r]. This choice of f is optimum in the sense of 
minimum mean square error E[|r — fp]. In this work, we find 
the linear approximation which gives a nearly consistent LLR 
pdf and results in the maximum achievable transmission rate 
on the channel. We call this linear approximation maximum- 
capacity linear- approximation (MCLA). 

Different linear approximations result in different LLR 
distributions for /. Each LLR distribution defines a corre- 
sponding C according to (|9|. Thus, the problem of finding the 
MCLA is simplified to finding a linear approximation whose 
corresponding LLR distribution maximizes the capacity C. 

Maximizing C requires a knowledge of (t„ and pdf of r. 
These are needed for finding the pdf of I and thus optimizing 
its corresponding capacity. So, we first assume that these 
pieces of information are available. Later we generalize our 
results to the case that (t„ is unknown. When (t„ is known, 
without loss of generality we set (7„ — an in ^ and we find 
the optimum choice of f. Notice that with f one can adjust a 
and thus the pdf of I as needed. 

MCLA maximizes a bound on the achievable transmission 
rate. To show that this optimization is meaningful in practice, 
we design irregular LDPC codes that approach this maximized 
capacity. More interestingly, we observe that the optimized C 
is extremely close to C based on true LLR calculation. 

MCLA is also expected to result in improved performance 
in iterative decoders. That is, for a fixed code, computing LLRs 
according to MCLA should improve BER performance. Our 
simulation results will support this claim, but the following 



two arguments can also be provided to justify this choice. (1) 
MCLA provides the maximum C and thus the maximum gap 
between the code rate R and the capacity C. Thus one expects 
improved BER performance. (2) Since I is not the true LLR, 
under any linear LLR calculation, C < C. Under a good linear 
approximation, pdf of I is close to that of true LLRs and thus C 
is close to C. Hence, a minimized C — C (through maximizing 
C) indicates a good LLR approximation. 

As mentioned, our simulation results show that MCLA 
indeed improves the performance compared to existing work 
based on choosing f = E[r]. Moreover, though not rigorously 
proved, MCLA appears to be the optimum choice in terms of 
BER performance too. Thus, our proposed method is based 
on maximizing C over f for fixed (t„ and (t„, and we define 

"Topt — argmaxC. (10) 

r 

The following theorem suggests that finding fopt can be 
done very efficiently. 

Theorem 1: For a fixed (T„ and (t„, there exists a unique f 
which maximizes (7=1— E;-[log2 (1 + e~')]. 
Proof: 

C=l- E,-[log2 (1 + e-')] = 1 - E,[log2 (1 + e't^)] 

= Ey 2 < 

+ ln2 

The above expression is negative since the term inside the 
expected value is always negative. Therefore, (7 is a concave 
function of f and there exists a unique maximum in f = fopt. 
This theorem is valid for any distribution of r > 0. ■ 

Maximizing C, therefore, is a straightforward task because 
it is a one-variable convex-optimization problem and can 
be solved very efficiently by simple numerical techniques. 
Different C curves are depicted in Fig. [T]for some f and the 
case (T„ = cr„. Notice that fopt is not very sensitive to cr„. 

Fig. |2] shows that we can get very close to the channel 
capacity under MCLA. Simulations show that f = E[r] 
can result in significant performance loss especially when 
the capacity or the code rate increases. This performance 
loss is about 0.24 dB in 0.5 bits/channel use to 0.92 dB in 
0.75 bits/channel use. 

The following two examples support our above mentioned 
results. In Example 1, we design an irregular LDPC code 
which approaches the capacity that is maximized by MCLA. 
Example 2 shows improved BER performance under MCLA. 

Example 1: Consider an uncorrected normalized Rayleigh 
fading channel with f7„ = 0.7436. The channel capacity is 
0.5 bits/channel use in the absence of SI and C — 0.4999 
using j'opt = 0.6594 (compare with E[r] = 0.8862). We design 
a code based on rate maximization under MCLA. We assume 
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Fig. 1. C for different cr,, and r on a normalized Rayleigh fading cliannel. Kg- 3- Comparison of BER for a 0^0000(^.2 .^.o) ldPC code in different 
Tlie curves are concave and tlie maximizing point is unique. Moreover, tlie cases on a normalized Rayleigh fading channel. The performance of MCLA 
maximizing point is not much sensitive to a-n- remains almost the same regardless of whether (t„ is known or not. 
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Fig. 2. Comparison between the highest achievable transmission rate in the 
case of true LLR calculation and C on a normalized Rayleigh fading channel. 
It is assumed that an = Un- 



a fixed p{x) ~ and a maximum variable node degree (i„ 
of 30. Under MCLA and 11 -bit decoding, and allowing a 
maximum of 300 iterations, the optimized code is given in 
Table U (Code 1). The rate of the designed code is 0.4889. The 
designed code has almost approached C and also the capacity 
of the channel with no SI. 

Example 2: To show that MCLA also improves the BER 
of the code, a C^°^°^ {x-^ , x^) LDPC code is simulated on an 
uncorrected normalized Rayleigh fading channel. Fig.|3]shows 
the BER of the code with and without SI at the receiver. When 
SI is not available and (t„ is known, two cases have been 
plotted. One is when (t„ = (t„ and f — E[r] and the other 
is under MCLA (i.e., (T„ — f7„ and f = ^opt). The decoding 
threshold of the code is 4.06 dB with f — E[r] and no SI, 
3.82 dB under MCLA, and 3.06 dB with perfect SI. The figure 
shows considerable BER improvement under MCLA. We have 
chosen a (3,6)-regular LDPC code since most of its results 
exist in the literature. If a higher rate code (e.g., R — 3/4) is 
used, the performance improvement increases. 



IV. Noise power unknown at the receiver 

Under MCLA, the pdf of / is a linear transformation of 
the pdf of y. In fact, ctopt ~ 2^ would give the linear- 
transformation whose associated capacity (given by (|9])) is 
maximum. When (t„ is unknown, the distribution of y is not 
known at the receiver Therefore, finding the optimum linear 
transform is somewhat meaningless. However, for any (t„ one 
can find ctopt- Thus, c^opt is a function of cr„. It is also obvious 
from Theorem 1, that aopt is unique for each cr„. Thus, aopt 
will be denoted as aopt(cr„) afterwards. 

Since (t„ is unknown, aopt(cn) is also unknown. However, 
one can find a such that a given code has the widest range of 
convergence over changes of an- This way, we ensure that the 
code is robust to the changes in the noise power (e.g. when the 
code is used in different channels with different noise powers). 

The basic idea for finding such a is to maximize the 
achievable transmission rate at the highest noise standard 
deviation that the code can tolerate under MCLA. To do this, 
for a given code, we must find the largest dn, referred to as 
cr*, such that the code still converges to zero error rate when 
LLRs are obtained using (|6]) with a = Q;opt(cj^). Finding cr* 
can be done efficiently through a binary search, but at each 
stage of the search aopt must be updated accordingly. 

This choice of a gives the widest convergence range over 
(T„, because it is the optimum a in the worst channel condition. 
When the channel condition improves, this choice of a is no 
longer optimum. But we expect that even with a sub-optimal 
a, convergence is achieved due to improvement in the channel 
condition. This can also be justified recalling that fopt (and 
hence c^opt) is not very sensitive to (T„. Our simulation results 
on LDPC codes will confirm that this choice of a provides 
the widest convergence range. 

In order to measure the performance we do as follows. For 
various (t„ and different values of a (including Q!opt(o'n)), 
we find the required number of density evolution iterations to 
achieve a target message error-rate (MER) pt for a given LDPC 
code. We use the required number of iterations £*{pt) as a 
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Fig. 4. Comparison between the performances of C°°{x^,x^') on a 
normalized Rayleigli fading cliannel with or without SI using different a. 

comparison measure and to identify the range of convergence. 

In Fig. in different values of a are used and (*{pt) is 
plotted for different values of (T„ for C°"{x^,x^). It is seen 
that by using a = aopt« = 0.6442) = 2.9634, the code 
has the widest convergence range. Interestingly, while this 
choice of a is not optimum for all values of cr„, the resulted 
£*{pt) is always very close to the curve based on known (7„ 
under MCLA. This observation can also be made from Fig. |3] 
The threshold of this code is at 3.06 dB with SI and is at 
3.82 dB with no SI under MCLA. Thus, the gap between these 
thresholds is 0.76 dB. At this code rate, existence of SI results 
in about 0.74 dB improvement [4], [8]. Thus, MCLA shows a 
minor extra gap (0.02 dB) compared to true LLR calculation. 

When cr„ is unknown, one can design an LDPC code 
with a given rate which under MCLA provides the widest 
convergence region, i.e., has the largest decoding threshold. 
This procedure has to be done carefully, because aopt is a 
function of ct* which is initially unknown. We omit the details 
of this code design procedure in the interest of available space, 
but one designed code is reported in Table I] (Code2). Again, 
11 -bit decoding under MCLA is used, the maximum number 
of iterations allowed is 300 and — 30. The threshold of the 
designed code is 2.76 dB. This code has the largest decoding 
threshold among all the codes with the rate 0.5. 

V. Conclusion 

We proposed a new method for linear LLR calculation on 
fading channels when channel fading gain is not known at the 
receiver. Our method is optimum in the sense of maximum 
achievable rate on the channel. We showed that on a Rayleigh 
channel, the maximum achievable rate using this method is 
extremely close to the channel capacity. Compared to existing 
work, which uses the expected value of the fading gain 
for LLR calculation, we reported considerable performance 
improvement at no extra decoding cost. This improvement 
would become more significant when the code rate increases. 

We then extended our approach to the cases that the additive 
noise power of the fading channel is also unknown at the 
receiver. With a careful choice of linear LLR calculation, we 





Codel 


Code2 


A2, A3 


0.1916, 0.2244 


0.1943, 0.2341 


A4, A5 


0.0057, 0.0109 


0.0064, 0.0113 


Ae, A7 


0.0427, 0.1187 


0.0340, 0.0994 


As, Ag 


0.0297, 0.0121 


0.0474, 0.0205 


Aio, All 


0.0147, 0.0000 


0.0119, 0.0171 


A15, A20 


0.0157, 0.0314 


0.0228, 0.0627 


A29, A30 


0.0382, 0.2649 


0.0680, 0.1715 


P9 


1.0000 


1.0000 


Rate 


0.4889 


0.5000 




0.7436 


0.7274 


Eb/No* (dB) 


2.57 


2.76 



TABLE I 

Good LDPC codes designed under MCLA. CodeI is a rate 

MAXIMIZED AND C0DE2 IS A THRESHOLD MAXIMIZED CODE. 



were able to obtain a performance almost identical to the 
previous case, where the additive noise power was known. 

For applications that channel estimation results in significant 
overheads or suffers from severe imperfections, our proposed 
solution can be of interest. 

While we verified some of our results through study and 
design of LDPC codes on Rayleigh channel, our approach for 
maximizing the achievable transmission rate and convergence 
range of the decoder is general. The only reason for using 
LDPC codes is that, they can approach theoretical limits and 
thus verify some of our asymptotic results. 
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